Method for generating and displaying a virtual object by an optical system

ABSTRACT

The invention relates to a method for generating and displaying a virtual object to an individual user by an optical system consisting of gaze-tracking glasses and at least one display unit connected to the gaze-tracking glasses, the display unit having a first display, the gaze-tracking glasses having a first eye-tracking camera, the first display being arranged in a first viewing region of the gaze-tracking glasses. According to the invention, the optical system is adapted to an individual user, a first target value for adaptation of a display control unit of the display unit for controlling the first display being determined, a current viewing direction of the first eye being determined by the gaze-tracking glasses, a virtual object being generated and, taking account of the first target value, the virtual object being displayed in the first display at a position in the determined viewing direction of the first eye.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a national phase application of PCTApplication No. PCT/EP2019/086307, filed Dec. 19, 2019, entitled “METHODFOR GENERATING AND DISPLAYING A VIRTUAL OBJECT BY AN OPTICAL SYSTEM”,which claims the benefit of Austrian Patent Application No. 51133/2018,filed Dec. 19, 2018, each of which is incorporated by reference in itsentirety.

BACKGROUND OF THE INVENTION 1. Field of the Invention

The invention relates to a method for generating and displaying avirtual object by an optical system.

2. Description of the Related Art

Glasses for so-called augmented reality as well as mixed reality aregaining increasingly more importance and popularity. In this case, dataglasses display information to the user in the field of vision. Suchglasses have at least one, at least partially transparent, display whichis arranged before at least one eye of the user. In contrast withso-called virtual reality, there is always a direct relationship withthe environment with augmented reality and mixed reality.

Numerous problems have occurred in the practical use of such glasses,such as Google glasses. Simply displaying information on the display,which is part of the glasses, has proven to be extremelydisadvantageous. The viewing behavior of the user is changedsignificantly by the display of the content. The user is actually barelysupported by the display of the information because the user's eyes areforced to continually switch between the displayed information and theenvironment. This quickly becomes tiresome and is a stress for the brainthat should be taken seriously. The displayed content also distracts theuser from the real environment because the optical attraction of a newlydisplayed piece of information diverts the eye of the user to thisinstead, regardless of whether there might be something more importantneeding more attention in the real world in another viewing direction.This has already led to accidents. Such glasses can thus have preciselythe opposite effect than intended. Instead of making a situation easierfor the user, such glasses increase the complexity. [05] In addition,all people are different to a certain extent. Human eyes are arrangedrespectively differently as relates to the nose and ears andrespectively also have a different distance with respect to one another.All people who wear glasses know the corresponding adaptations toglasses made by an optician, in which the optician adapts the glasses tothe respective conditions of the individual wearing the glasses throughmechanical changes to the glasses, for example by bending the sidepieces or the nose pad. Accordingly, optical lenses are alsoindividually adapted for a user.

With the known systems for augmented reality or mixed reality, it hasnot yet been possible to combine the display of virtual objects withobjects in the real world or to harmonize those in a definable andintentional manner

SUMMARY OF THE INVENTION

Thus, the object of the invention is to provide a method of theaforementioned type, with which the aforementioned disadvantages can beavoided and with which virtual objects can be displayed in a definablecombination with the real environment.

According to the invention, this is achieved by means of the featuresdescribed herein.

Content is thereby precisely displayed where a person is already lookingat the particular point in time. The direction of view of a person isseldom random; rather, there are usually causes in the environment ofthe person in question. The display of a virtual object in data glassesis a different event and draws the attention of the user. In numeroussituations, a user does not randomly look at a particular object in theuser's environment, but because there is a particular reason. If anobject appears in the data glasses thereof, the user automatically looksat this object. However, the user thereby loses reality from the view.In safety-critical environments, such as in industry or in a laboratory,this can lead to inattentiveness and accidents. Due to the fact that thecontent is displayed precisely where the user is already looking, theuser does not have to change visual attention based on the display ofcontent or of an image. The user can thereby respond to the realenvironment and to the displayed content equally. The user is therebysupported in the best-possible manner in mastering even the mostdifficult situations without being distracted or overburdened.

Data glasses, particularly an optical system consisting of gaze-trackingglasses and a display unit, can thereby be adapted to an individual userquickly and easily. It is thereby possible to display content not justanywhere on a display; rather, the particular optical system is adaptedsuch that the corresponding content can be displayed where a user islooking. It is thereby possible to combine the display of virtualobjects with objects in the real world or to harmonize those in adefinable and intentional manner

It can thereby be ensured that the content displayed on the display isin the actual viewing direction of the user or in a well-defined andintentionally selected position as relates to the actual viewingdirection of the user.

The method according to the subject matter is quick and easy toimplement in practice.

The dependent claims relate to further advantageous embodiments of theinvention.

Express reference is hereby made to the wording of the claims, wherebythe claims are included in the description at this juncture by referenceand are being asserted as reflected in the wording.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention is described in greater detail with reference to theattached drawings, in which only preferred embodiments are shown by wayof example. The following is shown:

FIG. 1 a first embodiment of a system according to the subject mattercomprising gaze-tracking glasses and a display unit, in a perspectiveview;

FIG. 2 a second embodiment of a system according to the subject mattercomprising gaze-tracking glasses and a display unit, in an outline;

FIG. 3 a schematic perspective view of the spatial arrangement of afirst and a second display opposite the eyes of a user;

FIG. 4 a diagram of an embodiment of a system according to the subjectmatter comprising gaze-tracking glasses and a display unit;

FIG. 5 a schematic perspective view of the spatial arrangement of afirst display, of a first eye, as well as of a real object (physicalobject);

FIG. 6 the arrangement comprising a first display and first eyeaccording to

FIG. 5 with a virtual object (TAG) shown on the first display; and

FIG. 7 the arrangement comprising a first display and first eyeaccording to FIG. 5 with a virtual object (TAG) arranged outside of thefirst display and not shown.

DETAILED DESCRIPTION

FIGS. 1, 2, and 4 each show different embodiments or representations ofan optical system 1, which is adapted to an individual user according tothe subject matter. Furthermore, the optical system 1 according to thesubject matter is used for the defined display of virtual objects 16which are generated in response to a definable state or a definableevent. These virtual objects 16 are shown in a defined visualenvironment in a definable position on at least one display 4, 10, ofthe system 1.

The optical system 1 consists at least of gaze-tracking glasses 2 and atleast one display unit 3 connected to the gaze-tracking glasses 2.

The gaze-tracking glasses 2 have at least one first eye-tracking camera5 for generating a first eye video of a first eye 6 of the user.Preferably, the gaze-tracking glasses 2 further have a secondeye-tracking camera 11 for generating a second eye video for a secondeye 12 of the user. The gaze-tracking glasses 2 preferably have at leastone field-of-view camera 14, which is pointing forward, from theperspective of the user 1 wearing the gaze-tracking glasses 2. The atleast one eye-tracking camera 5 or the preferably two eye-trackingcameras 5, 11 are arranged in so-called nose-piece frames of thegaze-tracking glasses 2. The arrangement of the two eye-tracking cameras5, 11 can be seen very well in FIG. 2.

Especially preferably provided gaze-tracking glasses 2, as shown inFIGS. 1 and 2, are known from AT 513,987 B 1, which contains furtherdetails on the preferred gaze-tracking glasses 2. The methods of thesubject matter may, however, also be carried out with othergaze-tracking glasses 2.

The gaze-tracking glasses 2 are provided and designed to detect viewingdirections of the user.

FIG. 4 shows, among other things, a block diagram of the gaze-trackingglasses 2, in which, however, actually implemented gaze-tracking glasses2 may have further components. In addition to the previously describedeye-tracking cameras 5, 11, the gaze-tracking glasses 2 particularlyhave at least one controller 18 of the gaze-tracking glasses 2 as wellas an interface 19 for communicating with the display unit 3. Thegaze-tracking glasses 2, moreover, have preferably further componentssuch as, for example, an energy supply unit.

The display unit 3 has at least one—at least—partially transparent firstdisplay 4, as is shown in FIG. 1. In particular, the display unit 3 alsohas a second display 10. The two displays 4, 10 may also be designed asa single part, in which, in this case, it is provided that theindividual display extends over both eyes 6, 12. According to thesubject matter, the first display 4 is consistently assigned to the lefteye of the user, in which this is not a forcible stipulation; the righteye can also be designated as the first eye 6.

The display unit 3 is preferably a device which is independent from thegaze-tracking glasses 2, which is designed, however, to interact with acertain type of gaze-tracking glasses 2 and is arranged on theseparticular gaze-tracking glasses 2 in order to be mechanically connectedthereto. According to the subject matter, the system 1 comprisinggaze-tracking glasses 2 and a display unit 3 mechanically connectedthereto is always used, in which a single-part design of the two devices2, 3 may also be provided.

The first display 4 is arranged, at least in regions, in a first viewingregion 7 of the gaze-tracking glasses 2. The preferably provided seconddisplay 10 is arranged, at least in regions, in a first viewing region13 of the gaze-tracking glasses 2. The viewing region 7, 13 in this caseis understood to be within the line of sight or the optical field ofvision of a user. In particular, the viewing regions 7, 13 are identicalto the lens-receptacle openings in the gaze-tracking glasses 2. To theextent that these are not lenses as such and/or do not have any or onlypartially formed frames, the viewing regions 7, 13 are particularly theregions at which the lenses would typically be arranged in conventionalglasses.

The first and possibly the second display 4, 10 may be arranged on theside of the gaze-tracking glasses 2 facing the user, as shown in FIG. 1,or the side of the gaze-tracking glasses 2 facing away from the user, asshown in FIG. 2. Moreover, they may also be arranged in thegaze-tracking glasses 2.

The first and possibly the second display 4, 10 are arrangedpositionally fixed on the display unit 3. There is no provision for themto tilt or swivel during operation. The display unit 3 also has nocorresponding actuators.

The first and possibly the second display 4, 10 are preferably designedas so-called wave guide displays and are substantially transparent.

The first and possibly the second display 4, 10 are preferably designedas so-called single-focal-plane displays. In this case, the display onlyhas a single display plane. In contrast, there are also so-calledmultiple-focal-plane displays known, which are not being used accordingto the subject matter.

FIG. 4 shows, among other things, a block diagram of the display unit 3,in which, however, an actually implemented display unit 3 may havefurther components. In addition to the previously described displays 4,10, the display unit 3 further has at least one controller 22 of thedisplay unit 3 as well as a first interface 20 of the display unit 3 forcommunicating with the gaze-tracking glasses 2.

Furthermore, the display unit 3 has a display control unit 8, which isconnected to the controller 22 or is formed integrally therewith. Thedisplay control unit 8 controls the first and the preferably providedsecond display 4, 10 and is responsible for the position and distortionsof an image or of an object 16 to be displayed on the first andpreferably second displays 4, 10. The image or object 16 is generated bythe controller 22 and transferred to the display control unit 8 fordisplay.

The display unit 3 further has a second interface 21 of the display unit3, which is provided for communication with the environment and designedaccordingly. Accordingly, suitable and/or preferred transfer methods orsystems are currently widely known and used and are characterized in thecellular telephone industry as 3G (UMTS), 4G (LTE), or 5G, in whichfurther systems from the Internet or WLAN may also be used.

Further corresponding protocols are, for example, IEEE 802 with numerousvariants.

Furthermore, the display unit 3 preferably has a navigation andposition-determination unit 23, which is connected to the controller 22.Corresponding units are known as smart phones. The navigation andposition-determination unit 23 can determine both the position of thedisplay unit 3 in a global coordinate system, particularly by means ofsatellite navigation methods as well as possibly with the inclusion ofthe connection data of a cellular telephone provider, as well as thespatial position or alignment of the display unit 3, particularly bymeans of at least one tilt sensor.

The display unit 3, moreover, has preferably further components such as,for example, an energy supply unit.

Because slight, individual deviations from the dimensionalspecifications can occur during production of the gaze-tracking glasses2 and/or the display unit 3, it is preferably provided that theindividual position and alignment of the first eye-tracking camera 5and/or the second eye-tracking camera 11 of each individual pair ofgaze-tracking glasses 2 can be determined on a measuring stand—beforedelivery—and the corresponding data can be stored in a memory or thecontroller 18 of the respective gaze-tracking glasses 2.

Furthermore, it is preferably provided that—likewise respectivelyindividually—at least one value is determined on the measuring stand forat least one definable optical error in the first eye-tracking camera 5and/or the second eye-tracking camera 11 and that the at least onedetermined value is likewise stored in the memory or the controller 18and considered in the subsequently described method steps.

It is further preferably provided that also the individual position andalignment of the first display 4 as well as of the preferably providedsecond display 10 of every single display unit 3 is determinedindividually on a measuring stand, and the data determined while doingso is stored in the controller 22 of the respective display unit 3.These data are preferably considered in the subsequently describedmethod steps.

The previously described determination of the actual dimensions andoptical errors takes place before the transfer of the respectivegaze-tracking glasses 2 and/or the respective display unit 3 to theuser. This is also characterized as intrinsic calibration.

Within the scope of the method according to the subject matter forgenerating and displaying a virtual object 16 by an optical system, itis provided that the optical system 1 is adapted to an individual user.This comprises at least the following steps:

-   -   The user puts on the gaze-tracking glasses 2.    -   Subsequently, at least one definable eye dimension and/or at        least one definable eye position of the first eye 6 is        determined by the gaze-tracking glasses 2.    -   Afterwards, at least one first target value of at least one        geometric display setting of the first display 4 is determined        from the at least one determined eye dimension and/or the at        least one determined eye position as well as the position and        alignment of the first eye-tracking camera 5.    -   A display control unit 8 of the display unit 3 is then adapted        at least to the first target value in order to control the first        display 4.

An individual optical system 1 according to the subject matter foraugmented or mixed reality can thereby be quickly and easily adapted toan individual user. It is thereby possible to display content not justanywhere on a display 4, 10; rather, the particular optical system 1 isadapted such that the corresponding content can be displayed where auser is already looking. It is thereby, furthermore, also possible tocombine the display of virtual objects 16 with real objects 15 in thereal world or to harmonize those in a definable and intentional manner

It can thereby be ensured that the content displayed on the display 4,10 is in the actual viewing direction of the user or in a well-definedand intentionally selected position and/or distortion as relates to theactual viewing direction of the user.

It may be provided that a corresponding adaptation or calibration isonly carried out once for an individual optical system 1 in order toadapt it to a particular user. It is preferably provided that theadaptation is repeated in definable time intervals.

The listed method steps are only necessary for one eye 6 and onlyexecutable for one eye 6. This relates to a user, for example, with onlyone eye 6 or situations in which only one eye 6 is used.

Preferably, the method or methods according to the subject matter areprovided for both eyes 6, 12 of a user. Therefore, the methods accordingto the subject matter are subsequently described particularly for twoeyes 6, 12, in which all method steps, which can also be executed withor for only one eye 6, are also provided as such for only one eye 6.

The method according to the subject matter thus has the followingfurther method steps in the preferred basic variant:

-   -   At least one definable eye dimension and/or at least one        definable eye position of the second eye 12 is determined by the        gaze-tracking glasses 2.    -   Afterwards, at least one second target value of at least one        geometric display setting of the second display 10 is determined        from the at least one determined eye dimension and/or the at        least one determined eye position as well as the position and        alignment of the second eye-tracking camera 11.    -   The display control unit 8 is then adapted at least to the        second target value in order to control the second display 10.

The individual steps are explained in detail as follows.

The placement of the gaze-tracking glasses 2 is identical to theplacement of any other glasses, is generally known, and requires nofurther explanation. The display unit 3 connected to the gaze-trackingglasses 2 is placed at the same time.

Following the placement of the gaze-tracking glasses 2, at least onedefinable eye dimension and/or at least one definable eye position ofthe first eye 6 and preferably also of the second eye 12 is/aredetermined by the gaze-tracking glasses 2. Eye dimensions areparticularly the diameter and/or the radius of the eye as well as thepupil diameter in addition. Preferably both are determined. Eyepositions are particularly the position of the pupils of the eyes 6, 12,particularly the distance between the two pupils, as well as the spatialposition of the two eyes 6, 12 as relates to one another. Preferablyboth are determined.

In order to determine the eye positions of the first eye 6 and of thesecond eye 12, it is particularly provided that a position of a medianof the eyes 6, 12 is determined. The median is characterized as acenterline of the body or of the head in the region of the eyes 6, 12.To this end, the position of the first eye-tracking camera 5 and of thesecond eye-tracking camera 11 is, furthermore, determined as relates tothe median of the eyes 6, 12.

In order to determine the eye positions or the eye dimensions, it ispreferably provided that at least one viewing pattern sequence of theuser is recorded at a definable plurality of defined control points. Theviewing pattern sequence or viewing sequence in this case characterizesthe viewing behavior of the user who is encouraged, starting from acertain location, to look at certain control points or to move his/herhead in a definable manner during the fixation of a control point. It ispreferably provided that the control points are arranged at differentspaces and distances away from the optical system 1. The resultingadvantages will be addressed at a later point in the document.

After the determination of the eye dimensions as well as the eyepositions, it is provided that at least one first target value of atleast one geometric display setting of the first display 4 is determinedfrom the at least one determined eye dimension and/or the at least onedetermined eye position as well as the position and alignment of thefirst eye-tracking camera 5. It is further preferably provided that atleast one second target value of at least one geometric display settingof the second display 10 is determined from the at least one determinedeye dimension and/or the at least one determined eye position as well asthe position and alignment of the second eye-tracking camera 11.

During this method step, values or parameters are thus determined whichare characterized as target values. These target values indicate theposition at which and/or the distortion with which an image or a virtualobject 16 must be displayed within the display regions of the respectivedisplays 4, 10 so that it must be displayed for the user, who is lookingat displays 4, 10 arranged before the eyes 6, 12, so as to ensure thatit is then displayed for the user at a very particular or definedlocation as well as substantially without distortion. In particular, thetarget values are not individual values but groups or quantities ofvalues or vectors. It is particularly provided in this case thatrespectively different target values are determined, stored, andconsidered for various eye positions that normally occur at differentobservation distances.

FIG. 3 shows a corresponding view of only the eyes 6, 12 as well as thetwo displays 4, 10.

Accordingly, the geometric display setting is at least one setting whichrelates to the geometric display of an object on the display but not thecolor or contrast thereof, however. The geometric display setting thusrelates to orientation or position, distortion, and size of a displayedobject 16 within a display region of the respective display 4, 10.

After the first as well as preferably the second target value aredetermined, the display control unit 8 of the display unit 3 is adaptedto at least the first target value in order to control the first display4 and adapted to at least one second target value in order to controlthe second display 10. The adaptation of the display control unit 8means that the objects to be displayed are shown to the user in themanner such that—relative to the eyes 6, 12 of the user—they areactually displayed where they are also supposed to appear and have thenecessary distortion level to appear undistorted.

The necessary degree of distortion as well as the desired position arealso not constant across all viewing states for an individual user. Inparticular, they change with the distance of a point at which the useris looking. Thus, as already indicated, it is especially preferablyprovided within the scope of determining the eye dimensions and/or theeye positions that first distance values of the first target value andof the second target value are determined at a first control point whichis arranged at a first distance away from the optical system 1 and thatsecond distance values of the first target value and of the secondtarget value are determined at a second control point which is arrangedat a second distance away from the optical system 1, in which the firstdistance is different than the second distance. Thus, different valuesor amounts of the first target value and of the second target value aredetermined for different focusing distances of the first and second eye6, 12 or for different positions of the eyes 6, 12 as relates to oneanother. In particular, it is provided that control points are arrangedat least four different distances. A corresponding curve can beextrapolated over the focusing distance from the determined distancevalues and stored for the future display of virtual objects 16 atparticular eye positions.

The type of target values is directly related to the type of displays 4,10 used. Displays 4, 10 often have basic settings, which are alsocharacterized as default settings. A corresponding image or video isshown according to the default settings without intentionally changingor adapting the video signals which are fed to such a display. Thecorresponding image will thereby normally be shown undistorted in themiddle of the respective display.

Thus, it is especially preferably provided that a first target positionand/or a first target distortion of a first display region 9 fordisplaying a virtual object 16 before the first eye 6 is determined as afirst target value of the geometric display setting, in which, startingfrom at least one deviation of the first target position and/or thefirst target distortion of the first display region 9, at least onefirst correction factor and/or one first correction function isdetermined for a first display region default setting of the firstdisplay 4, in which the display control unit 8 is adapted to the user atleast with the first correction factor or the first correction function.The first display region 9 in this case is a subregion within the firstdisplay 4.

Accordingly, it is preferably provided for the second eye that a secondtarget position and/or a second target distortion of a second displayregion 17 for displaying a virtual object 16 before the second eye 12 isdetermined as a second target value of the geometric display setting, inwhich, starting from at least one deviation of the second targetposition and/or the second target distortion of the second displayregion 17, at least one second correction factor and/or one secondcorrection function is determined for a second display region defaultsetting of the second display 10, in which the display control unit 8 isadapted to the user at least with the second correction factor or thesecond correction function. The second display region 17 in this case isa subregion within the second display 10.

In the aforementioned context, a correction function establishes arelationship between certain eye positions and/or viewing directions ofthe user and the respectively provided correction factors for thedisplay of a virtual object under the respective conditions. Eyes arecapable of making quasi-continual position changes. It has been shownthat the values of the correction factors show precisely suchquasi-continual behavior.

A simple adaptation of the displays 4, 10 or the display control unit 8is made possible due to the aforementioned use of correction factors orcorrection functions. It is especially preferably provided in this caseto record the correction factors or correction functions as a field withdifferent distance values.

FIG. 3 clearly shows how the respective display regions 9, 17 for thetwo eyes shown deviate significantly from the respective centers of thetwo displays 4, 10.

The display of a virtual object 16 in a definable relationship asrelates to the viewing direction or viewing behavior of the user isenabled by the adaptation of the optical system 1 implemented accordingto the subject matter. In particular, it is thereby possible to displaya virtual object 16 in a definable relationship together with a realobject 15.

Once the described optical system 1 has been adapted or calibrated tothe user according to the described methods, additional virtual objects16 can be generated and displayed. The following additional method stepsare provided with the method for generating and displaying a virtualobject 16 by an optical system 1:

-   -   A current viewing direction of the first eye 6 is determined by        the gaze-tracking glasses 2.    -   A virtual object 16 is generated in response to a definable        state and/or a definable event.    -   The virtual object 16 is displayed by the display control unit        8, taking into account the first target value, at a position on        the first display 4 in the determined viewing direction of the        first eye 6.

As previously indicated, the use of two displays 4, 10 is particularlyprovided. In this case, it is particularly further provided that thefollowing further method steps are implemented simultaneously with theaforementioned method steps, with correspondingly adapted or calibratedgaze-tracking glasses 2:

-   -   A current viewing direction of the second eye 12 is determined        by the gaze-tracking glasses 2.    -   The virtual object 16 is displayed by the display control unit        8, taking into account the first target value, at a position on        the second display 10 in the determined viewing direction of the        second eye 12.

When displays 4, 10 are used with default settings, it is particularlyprovided that the virtual object 16 is displayed on the first display 4offset and/or distorted by the first correction factor and/or the firstcorrection function as well as preferably that the virtual object 16 isdisplayed on the second display 10 offset and/or distorted by the secondcorrection factor and/or the second correction function.

It is provided that the virtual object is displayed at a position in thedetermined viewing direction of the first eye 6 or of the second eye 12.In this case, it is provided that the relevant position of the displaymoves along with the viewing direction or is shifted accordingly. Inthis context, it is thus preferably provided that the gaze-trackingglasses 2 continually determine the current viewing direction of thefirst eye 6 and/or of the second eye 12, and that the position at whichthe virtual object 16 is shown is continually adapted to the currentviewing direction or the current viewing directions.

Because at least one of the eyes 6, 12 can make certain slight,unintentional movements when viewing the virtual object 16, saidmovements being recorded respectively by the gaze-tracking glasses 2,direct following of the display position may lead to a continualmovement of same which the user perceives as being unsettling or shaky.In order to avoid this, it may be provided that the current viewingdirection must deviate by a definable amount, particularly by 2° (twodegrees), from a most recently determined viewing direction so that theposition at which the virtual object 16 is displayed is adapted to thecurrent viewing direction.

Alternatively, it may be provided that the respectively determinedviewing directions are averaged over a certain timeframe or a definableperiod in the past, and the position at which the virtual object 16 isdisplayed lies in the averaged viewing direction. The length of time inthe past in this case can be adapted depending on the situation.Preferably, the length of time in the past amounts to about 0.1 to 0.3 s(seconds).

The virtual object 16 is generated and displayed when a definable stateand/or a definable event occurs. In this case, such a state or such anevent may only be considered as having occurred when a definableplurality of criteria is respectively fulfilled.

According to a first preferred variant, it is provided that the opticalsystem has at least one field-of-view camera 14, in which a definablereal object 15 is detected by the field-of-view camera 14, in which thedetecting of the definable real object 15 is the definable event or acriterion for a corresponding event for generating the virtual object16. A user can thereby be supported, for example, in orientating in thereal world. Detection of a real object 15 is already possible by meansof corresponding image-processing programs. In this context, thedetection of a face may also be provided.

According to a second preferred variant, it is provided that the systemis designed for the detection of at least one state value of the user,that the state value is monitored by the system with respect to theexceeding of a limit value, and that an exceeding of the limit value isthe definable event for generating the virtual object 16. For example, afatigue value can be determined for a waking/fatigued state of the userfrom observing and evaluating the viewing behavior, to which end nofurther sensors are necessary.

It may further be provided that the optical system 1 has at least onefurther sensor for determining a physiological variable of the user,particularly heartbeat and/or skin conductance, and/or is connected to acorresponding external sensor in order to display the values thereof.

For example, the optical system 1 may also be connected to a bloodpressure sensor. Corresponding external sensors may also be sensorswhich record the bodily functions of living beings other than the user.For example, coaches can thus be informed of a critical state of one oftheir athletes. Furthermore, the at least one sensor may also be asensor of a technical apparatus.

According to a third preferred variant, it is provided that the systemhas at least one navigation and position-determination unit 23 fordetecting a spatial alignment as well as a location of the system 1 andthat a definable location as well as a definable spatial alignmentrepresent the definable event for generating the virtual object 16. Thedetection of a spatial alignment as well as a location of the system 1can particularly be supported by means of so-called location-basedservices, as they are known in the smart phone field.

FIGS. 5 to 7 show examples of the display of virtual objects 16 asrelates to a real object 15, in which it is insignificant whether thisreal object 15 is simply just there or has also been detected as anobject 15. In this case, FIG. 5 shows the first eye 6 of the user, whois looking at the real object 15 through the first display 4, the objectbeing characterized in FIG. 5 as a physical object. According to anespecially simple response, a virtual object 16 is shown on the display4 in the form of a frame such that this virtual object 16 borders thereal object 15 and the frame appears to be substantially rectangular.

FIG. 6 shows a similar situation in which, however, no real object 15 isshown. Instead of the border, a different virtual object 16 is thenshown in the form of a TAG. The TAG in question is shown adjacent to theviewing direction. Because it is clearly known where the user is lookingdue to the gaze-tracking glasses 2, the virtual object can be positionedin or next to the viewing direction such that it can be detected or seenby the user without any significant change in the viewing direction.

FIG. 7 shows the effects on the virtual object 16 or the TAG when theuser looks away from it or in the direction of a different item. Theparticular virtual object 16 in this case retains its assigned positionin space. Because it is then outside of the display region 9 of thedisplay 4, it is also no longer shown. As soon as the user has movedsufficiently in the corresponding direction, the virtual object 16 willalso again be displayed.

It is preferably provided that a focusing distance of the two eyes 6, 12of the user is determined by the gaze-tracking glasses 2 when the userlooks at the real object 15 and that the virtual object 16 is shownpositionally offset and/or distorted on the first and second display 4,10 such that it appears as a single object at the same focusing distanceof the two eyes 6, 12 as the real object 15. Thus, the virtual object 16is shown on the displays 4, 10 which are arranged directly before theeyes 6, 12 of the user; however, the eyes 6, 12 of the user see thevirtual object 16 at the same distance as the real object 15 to which itis assigned. This eliminates the otherwise continually necessaryrefocusing at different distances.

It is thus provided that the virtual object 16 is shown as a so-calledstereo image.

The focusing distance of the two eyes 6, 12 is determined by thegaze-tracking glasses such that the angular positions of the eyes 6, 12are determined and the distance at which the eyes 6, 12 will focus iscalculated therefrom. In this case, a distance value does not have to bedetermined in a unit of length. The focusing distance can also bedetermined and processed in the form of an angle or several angles. Inother words, the gaze-tracking glasses 2 thus determine a currentposition of the two eyes, and the virtual object 16 is shownpositionally offset and/or distorted on the first and second display 4,10 such that it appears as a single object at the distance at which thetwo eyes 6, 12 are oriented.

The system 1 according to the subject matter preferably does not have aseparate distance meter for determining a distance between the system 1and the real object 15.

In this case, it is particularly provided that the display control unit8 has at least one distance value of the first target value and of thesecond target value taken into account, the distance value correspondingto the focusing distance of the two eyes 6, 12, in order to display thevirtual object 16 on the first and second display 4, 10. In the eventthat no distance value or distance values of the first target value andof the second target value are stored, it is provided that the displaycontrol unit 8 interpolates between the two neighboring distance values.

1-14. (canceled)
 15. A method for generating and displaying a virtualobject by an optical system, comprising: detecting viewing directions ofa user by gaze-tracking glasses of the optical system, at least onedisplay unit being connected to the gaze-tracking glasses, the displayunit having at least one at least partially transparent first display,the gaze-tracking glasses having a first eye-tracking camera forgenerating a first eye video of a first eye of the user, the firstdisplay being arranged, at least in regions, in a first viewing regionof the gaze-tracking glasses, the viewing region being assigned to thefirst eye; and adapting the optical system to the user according to thefollowing steps: putting on the gaze-tracking glasses by the user;determining, subsequently by the gaze-tracking glasses, at least one ofat least one definable eye dimension and at least one definable eyeposition of the first eye; determining, afterwards, at least one firsttarget value of at least one geometric display setting of the firstdisplay from the at least one of the at least one determined eyedimension and the at least one determined eye position, and a positionand an alignment of the first eye-tracking camera; adapting a displaycontrol unit of the display unit at least to the first target value inorder to control the first display; determining a current viewingdirection of the first eye by the gaze-tracking glasses; generating avirtual object in response to at least one of a definable state and adefinable event; and displaying the virtual object by the displaycontrol unit, taking into account the first target value, at a positionon the first display in a determined viewing direction of the first eye.16. The method according to claim 15, wherein the gaze-tracking glassescontinually determine the current viewing direction of the first eye andin that the position at which the virtual object is displayed iscontinually adapted to the current viewing direction.
 17. The methodaccording to claim 15, wherein the current viewing direction deviates bya definable amount from a most recently determined viewing direction sothat the position at which the virtual object is displayed is adapted tothe current viewing direction.
 18. The method according to claim 17,wherein the current viewing direction deviate by 2 degrees from the mostrecently determined viewing direction.
 19. The method according to claim15, wherein at least one of a first target position and a first targetdistortion of a first display region for displaying a virtual objectbefore the first eye is determined within the first display as a firsttarget value of the geometric display setting, wherein, starting from atleast one deviation of at least one of the first target position and thefirst target distortion of the first display region, at least one of atleast one first correction factor and one first correction function isdetermined for a first display region default setting of the firstdisplay, wherein the display control unit is adapted to the user atleast with the first correction factor or the first correction function,and in that the virtual object is at least one of displayed on the firstdisplay offset and distorted by at least one of the first correctionfactor and the first correction function.
 20. The method according toclaim 15, wherein the display unit has at least one partiallytransparent second display, wherein the gaze-tracking glasses have asecond eye-tracking camera for generating a second eye video of a secondeye of the user, wherein the second display is arranged, at least inregions, in a second viewing region of the gaze-tracking glasses, theviewing region being assigned to the second eye, wherein at least onedefinable eye dimension and/or at least one definable eye position ofthe second eye is determined by the gaze-tracking glasses, whereinafterwards at least one second target value of at least one geometricdisplay setting of the second display is determined from at least one ofthe at least one determined eye dimension and the at least onedetermined eye position, and the position and alignment of the secondeye-tracking camera, and wherein the display control unit is thenadapted at least to the second target value in order to control thesecond display.
 21. The method according to claim 20, wherein: a currentviewing direction of the second eye is determined by the gaze-trackingglasses; and the virtual object is displayed by the display controlunit, taking into account the second target value, at a position on thesecond display in the determined viewing direction of the second eye.22. The method according to claim 20, wherein: at least one of a secondtarget position and a second target distortion of a second displayregion for displaying a virtual object before the second eye isdetermined within the second display as a second target value of thegeometric display setting; starting from at least one of at least onedeviation of the second target position and the second target distortionof the second display region, at least one of at least one secondcorrection factor and one second correction function is determined for asecond display region default setting of the second display; and thedisplay control unit is adapted to the user at least with the secondcorrection factor or the second correction function, and in that thevirtual object is at least one of displayed on the second display offsetand distorted by at least one of the second correction factor and thesecond correction function.
 23. The method according to claim 20,wherein, during the determination of the eye positions of the first eyeand of the second eye, a position of a median of the eyes is determined,and the position of the first eye-tracking camera and of the secondeye-tracking camera is furthermore determined as relates to the medianof the eyes by means of the gaze-tracking glasses.
 24. The methodaccording to claim 15, wherein, for the adaptation to the user, at leastone viewing pattern sequence of the user is recorded at a definableplurality of defined control points which is arranged at differentspaces and distances away from the optical system.
 25. The methodaccording to claim 24, wherein first distance values of the first targetvalue and of the second target value are determined at a first controlpoint which is arranged at a first distance away from the opticalsystem, and in that second distance values of the first target value andof the second target value are determined at a second control pointwhich is arranged at a second distance away from the optical system,wherein the first distance is different than the second distance. 26.The method according to claim 24, wherein the gaze-tracking glassesdetermine current positions of the two eyes, and in that the virtualobject is shown at least one of positionally offset and distorted on thefirst and second display such that it appears as a single object at thedistance at which the two eyes are oriented.
 27. The method according toclaim 15, wherein the optical system has at least one field-of-viewcamera, wherein a definable real object is detected by the field-of-viewcamera, wherein the detecting of the definable real object is thedefinable event for generating the virtual object.
 28. The methodaccording to claim 15, wherein the system is adapted to detect at leastone state value of the user, in that the state value is monitored by thesystem with respect to the exceeding of a limit value, and in that anexceeding of the limit value is the definable event for generating thevirtual object.
 29. The method according to claim 28, wherein the leastone state value of the user is a fatigued state.
 30. The methodaccording to claim 15, wherein the system comprises at least onenavigation and position-determination unit adapted to detect a spatialalignment and a location of the system, and in that a definable locationand a definable spatial alignment represent the definable event forgenerating the virtual object.